The Role of Left Inferior Frontal Gyrus in the Integration of Pointing Gestures and Speech
نویسندگان
چکیده
Comprehension of pointing gestures is fundamental to human communication. However, the neural mechanisms that subserve the integration of pointing gestures and speech in visual contexts in comprehension are unclear. Here we present the results of an fMRI study in which participants watched images of an actor pointing at an object while they listened to her referential speech. The use of a mismatch paradigm revealed that the semantic unification of pointing gesture and speech in a triadic context recruits left inferior frontal gyrus. Complementing previous findings, this suggests that left inferior frontal gyrus semantically integrates information across modalities and semiotic domains.
منابع مشابه
Differential roles for left inferior frontal and superior temporal cortex in multimodal integration of action and language
Several studies indicate that both posterior superior temporal sulcus/middle temporal gyrus (pSTS/MTG) and left inferior frontal gyrus (LIFG) are involved in integrating information from different modalities. Here we investigated the respective roles of these two areas in integration of action and language information. We exploited the fact that the semantic relationship between language and di...
متن کاملHearing and seeing meaning in speech and gesture: insights from brain and behaviour.
As we speak, we use not only the arbitrary form-meaning mappings of the speech channel but also motivated form-meaning correspondences, i.e. iconic gestures that accompany speech (e.g. inverted V-shaped hand wiggling across gesture space to demonstrate walking). This article reviews what we know about processing of semantic information from speech and iconic gestures in spoken languages during ...
متن کاملFrontal and temporal contributions to understanding the iconic co-speech gestures that accompany speech.
In everyday conversation, listeners often rely on a speaker's gestures to clarify any ambiguities in the verbal message. Using fMRI during naturalistic story comprehension, we examined which brain regions in the listener are sensitive to speakers' iconic gestures. We focused on iconic gestures that contribute information not found in the speaker's talk, compared with those that convey informati...
متن کاملSuperior temporal sulcus disconnectivity during processing of metaphoric gestures in schizophrenia.
The left superior temporal sulcus (STS) plays an important role in integrating audiovisual information and is functionally connected to disparate regions of the brain. For the integration of gesture information in an abstract sentence context (metaphoric gestures), intact connectivity between the left STS and the inferior frontal gyrus (IFG) should be important. Patients with schizophrenia have...
متن کاملA Supramodal Neural Network for Speech and Gesture Semantics: An fMRI Study
In a natural setting, speech is often accompanied by gestures. As language, speech-accompanying iconic gestures to some extent convey semantic information. However, if comprehension of the information contained in both the auditory and visual modality depends on same or different brain-networks is quite unknown. In this fMRI study, we aimed at identifying the cortical areas engaged in supramoda...
متن کامل